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ABSTRACT ' / . 

Many research studies which deal with the teaching of 
econoaics at the college level conclude that different teaching 
■ethods do not lead to very different results in tens of student • 
achieveaente This paper, sliggests that one reason student achievement 
Bay fail to deaonstrate the superiority of one teaching aethod over 
another is that achieveaent is a function of a student's intellectual 
ability and tia6 put into the course^ It is suggestcdjthat less 
effort and tiae studying .econoaics and additional le^ure tiae^ . 
instead of iaproved achieveaent, aay be the doainant benefit of a 
different teaching aethod, Jo test this hyp,othesis, a-dependent 
variable was desigjied to aeasure the change in a student's effort in 
econoaics based on an econoaic learning aodel developed by BcKenzie 
and s€aaf. Three effort variables were constructed aid tested to 
deteraine if effort was correlated with^grade expectation, student 
attitude, sex, 'age, hours worked, day or night Classens, or having had 
or not had a high school course In econoaics. Results indicated that' 
non-wotking students and those students whd expec't and/or receive 
high grades exhibit aor^ effort. It is suggested thatjthe effort 
variable be taken into consideration in evaluatiifg^ teaching ie'thods. 
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In recent years^ the number of st;udies dealing witH^ the te^ch- .* 
ittg of economics at the college or adult level has increased from 
about 240 in 1969 to over 700 by the spring of 1976 (2). A large 
percentage of these studies have discussed eit,her genefal course 
evaluations or the* controlled evaluation of various teaching methods 
,such as, computer-assisted Instructi'^n , personalized methods •f in- 
struction, the use of audio-visual materials/ etc., (1,2,S,6,7, 
14,15). 'Many of these studies have focused -on trying to examine 
the factors affecting student achievement in a course under different^ 
teaching methods. Mpst economic education researchers have used ^ 
.the Test of Understanding in College Economics (TUCE)'to measure 
student achievement in economics. In addition- to the absolute achieve- 
ment score on the TUCK-, other dependent variables include such itfeasures 
as absplute ^^inprovement, percentage improvement and gap-closing 
models (3,9).^ 'Many studies hav6 concluded that different approaches 
to teaching do not l&ad to very different results in terms x)f the 
above measures of achieveitient (1,2,7,15). 

However, there are' several reasons that the "traditional" use 
of one of the four measures may fail- to provide evidenjce of one 
particular teaching method being superior to another approach.. In 

a, recent artitle, Van Metre (16) points out that many studies fail 

■ . ' ^ •'- 

to consider, much less try to measure, the different types of 



■ V 

learning that take place" in a course. 'Van Metre suggests 'that 



most studies have rtot ' attempted to match the method of ins'truction 
with particular types of learning, with course objectives, or with 
the various testing devices or measure's.. The discussion presented 
by Van Metre suggests 'that the loXij TUCE'scorea may not match with 
the course objectives.' Therefore, the TUCE scores, aay not be ap- 
p^ropriate selections as dependent^ variables in the regression 
analysis. 

A second reason , the use of one of the four TUClt measures may 
fail to demonstrate the superiority of one method over another is 
the fact that student achievement is' a function of a student's in- 
tellectual ability^ -and the amount of time the student puts intb the ' 
course. Several different researchers have suggested that changes 
In achievement may not be th6 sole^^or even the dopinant benefit of 
a different teaching "approach* (1,7',11,12,.13.) If we view th^ 
,student as a decision-maker with various gpals entering^ into his/ 
her utility function the results of earlier studies are placed into 
a different context. Consider a Jlrepjresent^tive student at point M 
orn Indifference Curv^ I 'in Figure 1* For a given- teaching technique 
A, the student 'can gain^ some maximum amount of achievement as ^ven 
by the horizontal inter cepjt' of tlie budget liae,.,^ "improved" 
teaching technique B pan imih.icltly be viewed as* a f ivot ^of the - / 
(time) budget constraint as Shown by the dotted line. Given this 
improved t(eaching technique the student can utl^ze it to capture 
ihore' leisure time, more achievement in ecpnomlc^ or a* combination of 



the two, resulting 'in a move from M to M' . DecJ.sion maki;ig theory 
suggests that usipg levels of achievement as the 'dependent variably 
may miss the majpr benefits of a particular teaching method, fiamely^ 
less effort and time spent studying econom^s .and additional leiy^re 
time (assJhing ^h^ student is willing to keep approximately tife sane 
level. of achievement). ^The^usual empirical, researbh approach implj.cit 
assumes that M' is horizontal to M: the stl|dent captures all the . 



benefits from improved teaching method B in term's of )(\±gher achieve- 
ment. It may.be, given the student's preference fy^cJiion, that 'the 
gain is taken in more leisure:^ a more vertical ^(ovement •to .tHe 
new M' . ' 

In fact, one might argue that if one really, believes^ B, is a 

superior^ teaching method*(one that enables ^the stud^ent to'/gain more 

achievement per unit of leisure time foregone) and if the researcher 

cannot demonstrate that the Students ar^ doing/better in terms of 

achievement, then 'one might infer that the sJt^dent must be taking 

the gains in terms of increfsed leisure time and holding their- 

level of achievement constant. The issue tbten becomes one of finding- 

an alternative to use as the dependent variable which will measure 

the chan|e in the .student's effort in economics. One such variable 

Wouldjje time spent on the course. 'However, this variable is com- 

f - . 

plicated by the fact that students with different learning abilities 

inay attain different levels of achie/^ement even though they spend the 

same amount of time on the course. 



* McKenzie and Staaf (11| have, d6v6loped 'a model which is de-* 
rived from the work-leisure model of wager theory. The work*-leisurd 
model of wage fh^ory assumes that a person/ s total income ^^'com- 
posed of two parts. The first part is unearned income or wealth 
which is "g4-ven".' The second part is earned income which is a fun'c- 
tion of wage rate and^tj/me effqrt. Unearned income and earned in- 
come combine^ to give the total incotne figure. Consider two individual 
X and Y, both who eanr $50. -per hour. X starts out with $1,000 
wealth. ^ Y starts with $100 wealth. ' For both to achieve a wealth ^ 
level of $2,D00, Y is. going to have to work more hours than X s^nce 
Y has to ear^n $1,900 whereas X only has to earn $1,000. Thus; wh^n. 
both^reach $2,000 of wealth we can^say that Y has exhibited more ^ 

'time effort in the pursuit of that leyel of wealth than X <Jid. ' 

The Learning Model * * 
McKenzie and Staaf used this wages fund model to develop ah * 
economic learninglmodel. Achievement in ecoijomics is ytewed as 
"wealth". The student's score on a TUtE pre-test represents the 
5tock of knowledge ^of economics at the beginning of the cpurse ( 
That^ stock of economic achieyeraent is probably^^a f unction^f .pkf ental, 
background,; newspaper availability in the hcfmer the level of social ' . 
science instruction in high school, etc. . The student ''s score on a ' 
XOCE'post-tesl: represlnts total "wealth" at the end of the course . 
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whioh is composed df the stock of knowledge at the beginning 6f -the 
cqirfse plus the addition to the stock of knowledge duri^n^ the course*. 

♦ * r ^ • * 

fh^^studejit' s I.Q. or^SAX score represents the* student ' s a'bility to 
translrate time into increased ^:novledge (7,ovlO,14,15) . -One would ^ 
e::pect: those stuil^n-c^ wich a. high Si^fT score to l^arn .lure pei .^:;ie '* 
unit ji study in any type of intelle€?tual endeavor. Consider cVo * 
students: A and B. Both start their economics course with the same 
stock cJf economic , knowledge as measured by a TUC£ pre-test score- ' 
At the end of the course both students h^e iraprovei to a stock of ' ^ 
knowledge of 20. If, A has a combined SAT , store -of 600 and B has a ^ 
combined SAT score of '1000 it is argued by Staaf and McKenzie that 

. ' # V. / 

A has put greater effort into the course than B since A has ^a lower > < 
\ learnj-ng rate than B. To summarize, an Individual enters an e^6nomics 

\ courseiwith some wealth of knowledge of economics (pre-TUCB score), 

generally ^leaves the (bourse with some greater knowledge of economics 

(post-ffUCE 'score') . Brighter student^s need apply less effort to achieve 

^he same gain in vealth as do less bright students*. 
" ' * Thus, the 'following utgility and learning functions place the v , 

model into a decision-making framework. Equation (1)' is a student 



utility function which* 










(1) U = f (A*,L) 




4 






(2) A^= I + E (R) 










. ■ "(3)" T = E + L 
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(4) M = U (A,L) + (T-E-L) 

(5) iA = R 

(6) E = A:! 

. R. . . 



where * * 

U = Utility , ^ ^ , ' ^ 

A = Achievement (post-TUCE) ^ . * • . 

L = Leisure • " " 

. ' 1 = Initial level, of knowledge (pre-TtJCE) 

E = Effort 

R = Learning rate (SAT score) 

T = Time constraint • > * 

M= Constrained maximization function _ • • ' 

*is a function of achievement in economises and leisure, i..e. , all 
"time not'spent on the subject" of .study. Equation (2) says that ^ 
final achievement is ^qual tp iDiti^l achievement plui effort times 
the learning rate/ Equation (3) • is^the time constraint. Equation 
(4) is the constrained utility maximization problem the "La- 
gr'ange" multiplier analyst*. Eq-uati^,(5)- gives the first order con- 
dition for utility /maximizat^-on:- The firW order" condition states , 
that the individual's indifferenc^ curve (his/her willingne^ to trdd 
achievement in e'conomics for' leisure) will tangent to the learning 
' curv^ at tha point pf utility maximization. Equation (6) defines 



• If 



scholast 



t the point < 
m^cp effort. 



in the course to be the gain In knowledge of 



^ . . -8- 



ERIC 



economics divided by intellectual* ability where ability is^mea^jred ^ 
.'• t I * * * ^ 

by the SAT or some, equivalent* measui;e- tt ^is im^rt^t to npte chat * 
this scholastic effort is ijot the same .as time spent, studying ecqnomics. 

. According to the modpl aut'lined hefe scholastic effort is 
empiri gaily revealed by the term^ on the right hand side of Equation ^ 

' / ' ' '• . ' ■ ' • 

(6). Thi^ "is. analogous to the time effort of the" wage theory model 

r / 

which states that *tirae ^.f fort is the change in wealth divided by tb^ ^ 
vage rate. This is seen in Figure 2,^hich is a graphical representa- . 
-tlon o'f. K'c 2. abov^ modelr is this last terra from Ecfuation (6)^which 
is the re^^tibnsjiip dc^sidered -in t^e paper. 

/ • ■ . " ■■ ■ 

'An Empirical Test Qf the Model 




The main que.stion addressed by an eTrit)irical test of a n^w model 
is whether one can constructtan effort variable such as the one dis- 
/ cussed by Staaf and McKenzie. If so, then a second question i§ the 

extent to which that^ dependent variable correlates with some hypo- , yj 

thesis' about its relationship to other variables. An important 
part- of this second categor^ is whether different subgroup)^ of 
students (male-female) exhibit different levels of effort. T\ie 
issue is related -to xhe follc#/ing type of statement: "It^is a real 
pleasure to teach older students since they are better motivated 
and put more effort into this tit)urse than students just t)ut ,of high • 
schoj^l." Thus, the purpose of the empirical results reported here 
are narrowly defined to (a) construct such. an ^effort variable and .(b) 
to examine its relationship to selected student characteristics. 



^ • r • i ' -9 . > t . 

All students at Virginia Commonwealth VniverSity who were t^kijfig ^ 
the basic 'Economics course in the Fall ^Term (197?) were teked to fill \ 

■ ' ■ ' ' ■ r . ' • • r . 

out a questionnaire Vhich asked the students^ for their age, s.ex, 
year in school, hours of ^outside work, etc/ In addition*, /the students 
v^ere given an attitude towards economics test (4)*knd a pre-TUCE 
• in the first week of the ccurpe. At the end'pf the s^me^terT the same* ^ ^ 

attCl^ude toward economics test and a p6st-TUCE were administered. ^ 
Fir^lly, the students* SAT^scores and final grade in economics were ,^ 
obtained. The combined SAT scores may be regarded as 4 measure of 
the student *s ability to 'translate time into knowledge. However, 
, it m^y be argued .that 4;he analytical nature e^^onoifics may be 
more strang-ly related to mathematioal ability and that only SAT • » 

^- ' . .' ^ . ■•->'•. 

k' math sc'ore should be used (8)i In order to consider this possibility, 
'\ three different effort, variables wer^ constructed and ^ttidied. One 

v3 . . ' ^ \^ - 

!^6f the effort variables uged the matheinatics ^AT score, another 

^ffprtr variable u^ed'the verbal SAT score, and the* third us^ the / 

combined. SAT score as a prox^ €0 the learning or aptitude or *ratj^ 
^ ^- . . ' ' " - . - 

These tfiree effort variables were tested in two different ways. 

The first way was "to use^ regression analysis tb determine the statis- 

tically .significant factor. The .three effort variables were regreased 

^ on $our course restated faptors: the §tudent*s expected grade upon, ^ 

entering the cotrfse, the actual ^inal grad^™"fite pre-aCtitude ^corfe * *r 

■ • \ • • \ . 

nd post-attitude gcore. The tationale for picking these course 
relatel factors was to ascertaii) if effort W4S correlated with either 



/ 



' 10 



of the two grade variable^ or with either 'o§ the two attitude variables.. 

In addition to these course yelated factors several demographic 

variables were inclvded in the set of independent variables. -These 

* $ 

demographic; variables include sex, '^q, ^hours worked, year in scho*ol, 
^ * ' ' ' ^ * ' ' •'• 

day or night class ahd having had or tiot had an economics course in 
high school. The rationale for, picking the demo^naphic factors* was 
to try 'and determine if students with 'different demographic charac- 



teristics exhibited^ different level? of effort as defined by the 

learn^.ng thebry model. Using*a .stepwise procedure with, the most! . »' 

significant variables' entering the equation ^irst, theAnly statf;LsticaH.y 

significant variablea found w^e (1) the hours worked and (2) the 

* 

expected grade upon entering the' course. The* 'more hours the student' 
was employed the smaller, was 'the effor^Nthat wa^ "demonstrated in the 

: ■■*'': ^ - ' " ' . * 

basic economics course*' This result' is to be expected since Tiavirtg# 

a job places other obligations uf)on the^stud^ht. The coefficient 

op the expected grade variable wgs positive indicating that the ^ ^ , 

higher the expected grade in the course at thre beginning of the 

semester, tfhe greater wpuld be the level of effort demonstrated in 

the course. The remaining variabl*es were not found to be statistically 

significant. ^ - 

^ * I *^ ' ^ 

A second app^r^ach was A) divide the total data set into more f 

• • ' . ; ' ' ^ 

V distinctive groups in order to -determine if there was a staf istically 

significant dif f4rence*in the effort scores generated by different' 
*sub*groups\ "fhis '^r.Dcedurie enables thp researcher to examine suhy 
g^ups in a more specialized manner. Again, the subgrouplngs were 



i ; ' • V ' "'V . • ^ ^ ^ '\ ^ • ' 

classified as Either course related ^gx;- demographic. . ^ . * 

' ^ . ^ /\ • . ' ^ » . ' 
' Th^ course rele^t^d^^ifaQtQur^'^that'Vere su'bdivided were (1) ex- 

^ ' pected grade upon enteifing '{:fie. cpur^e,*^^(2) final gradV,-' (3) pre-r * ^ 

attitude sc6T6,,,aaii' (4) post7frt%it*irde store" With respiP'Ct to- grades \ 

it i^ thus possible to ej^aming^ the level of effort exhibited hy^ those^ 
\ . ' . ' , . . ' ' » ' " 

, * students receiving an* "A" in ,tfie course ;>s cot^p^lred ytb thosg receiving 

a lower, grade. .This provides a sdmewha-t' different p'ersp^tive i:han 
^»*'»**, / 

\ • ' ' * ' 

i . ' regression analysis where effort is regressed on all 'grades. In 

a Sj.milar fashion the . resea^^cher'-dan d^tvide the data into those . 

^ ^ \ receiving a "B^or bettei^f "C-orbettr^", etc. rt- was hypothesized . ^ 

that higher grades, both expected ^tjdwctii&l,, as weH^^as highesJ ' , . , 

^ ■ - '* * ' ' ^ / w ' ^ ' ' . * 

attitude scores, bothpr^and poa£-\ would exhibit -kigher levels <if 

. ■■ • ' • • ^ ■ ■ ■ .' -4 

effort in t!ie counse. With, respect- to bath grade variables this - V 

• ■ \ 

hypothesljS was substantiated only for thoffe students who did vejry | ' 
** well in tl]e course for the verbal effort and ma«th effort variable* / > -i 
but not for the cumulative effoi;t var^ble.* Thpse student!^ yho 
received a final grade of *'A" exhibited %iore .effort than the res,t * 



, o£ the ^tudent^. However, the groupina of "A", and "B" stuafents did 
not exhibit a higher level of effort than those who scored lower 

\ grades.' N<j>'did the opposite low grade (5) 'e^chfbit a statistically 
significant lower 'level of effort.* A similar resul|: is obtain^jl 

fo'r the expected grade variable: Thos€ wl^ expected , an "A" exhibited 

^ - ^ • ^ ' ^ \ ' 

more effort than those who expected ar lower grade. ^- • ' 

The division 'of the\c[ara s^4t into difi-e rent .subgroups by 450th ^ 

. ' . * . , * „ • ■ / : ■ 
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' preattituch^ 4nd post-^attitude, scores x/as al^ done. Xbe ^lata set 
scores were^ diyic^d into two giro.ups picked from the tails of jthe dis- 
tribution to Observe'df those, who had: very negati^ve ,(c^ very positive 
attitudes) towaVd economics exhibited a dif f efent ^levei Of ^ffort;-^* 
than the rest of tlje data set. The results seem to indicate that' 
^^eJther of the extreme »sp^division (positive or negatiy^) ejphibited^ 
a statistically. Significant different level of effort 



dents in* the remaining part^of the/ data set. 



with regard to* the demographic subgYoups% ' the classif icatio'ns 

that were significant were age^ and the student's numbet of hours ^ 

. ' ' • ' • ' / ' 

the student was employed. The age factor 'suggested^ that yonng6i?\ 

students .exhibited a higher 1 evel of eff.ort. The work variable * 
k ' • • - ♦ « , 

f • ^ * ' , ' ' 

indicated that those who did not^ work '^^hi.bj.ted a) higher Jeve 1 of 
e^foft.^ Thfe significance' of the work factor is'^^^t^ surprising. 
^ The age factor was more interesting. If a Wrger percentage of 
^I'der student ' s- worked, then these'twp p^terns would .complemej^ 
each other^ However, this^is ^ot the case* at VCOy; VCU 'basiqally 

' ^ ' ^ ; . I'M ' ' / • - 

a commuter school.. Most VCU students, come frpm low and middle In- ' 
come families. Conse^ently, many VCU ^'tudent^ have part-time or** 



full time jobs. 

* The two statistical methods, the regression analysis and th^ 

, difference between means ^ both seem to indicate that non-wdrking- 

- students e^ibft higher levels' of effort;" and fhat tliose students ^ 

who expetit and/or receive high grades exhibit more scholastic Effort 
I ^ * ' 

in economics as defined by the learning theory model (11). However, 



neither the preattitude , noc the post-attitude measures offered sup- 
';port to the hypothesis tha-t those students with favorable attitudes 
' , toward econbmi(?soi?ould e;^hlbit more effort in economics than those 

; • • ^ \ . . . 

stuoeni^ with less favorablfe* -attitudes ► , - / . 

ETducational.Significancfe ^ . • 
T^is study indicates an important' redir|ection that evaluations 
^ of different -teachiiTg techniques or- studies of student" evaluations 
of 'teachers may want to consider. The re&ults indicate that the 
^effort variable as defined in the learning theory model of ^taaf 
and McKenzire (11) can be constructed and empiric^lfy tested. Althaugh 
\his study is only a pioneering effbrt i^j developing and testing a 

' • ■ N . . . , 

more complete mode! of learning behavior, the fQllowing statistical 

results are important^: (1.)' employed stude'nts reveal less effort 

• «•***" » 

than non-working students or than students who work fewfer hours, 

(2) deraograph?.c factors such as the year in school or the sex of the 

student do not surest any difference in effort revealed. 

The principle finding of this 'study is^the direction it suggests 

for future research. The Implications would appear. to be strongest 

fo*r studies dealing with different teaching tecfitliques. The in- 



^fi^lfcrpdration of decision-making theory 'into the evaluation pracesf^^ 



and, its implications for the, student ' s trade-^off between achievement 
and leisure are quit^ important. The real advantage of. systems such 
as TIPS, personalized instruction, or teaching through the use of 
A-V materials may not be higher achievement, in the course under con- 
sideration. The real advantage of a teaching method may be that 
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less time effort needs, to be ^spent on a particular subject 'to achieve 

* ' * • ^ f 

.a given course ^grade. • * 
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1. Verbal Effort 



2. Math Effort. 



Regression Analysis of "T^e Relationship 
between Effort and Selected Variables 



-•.00056 .W019 Hours.Worked + .00388 Expected G.ade' 

(3.152)^ ■ 1'^^^ ^.^1 

' ' ■' 

- .00175 .,g901^^ Hours Worked + -".00387 Expected G ade 

I . "• (2.816) a R' = .12 



3.. Cumulative Effort -'.00056 - .00009 Hours Worked .00191 Expected G^'ade 



't" values in parenthesis ^ 



(3.192) ^ : 



(2.675) 



R-- = .1,8 
F = 9. J 3 



.1 



r 



\ 



ERIC 



# % 



1 t 

/ 



16 



* 9' 



Table 2 



Differences io Means of Effprt for 
Selected Subsets of S'tudents 



Male . 
Female 



Age-^20 or more 
Under 20 



Day Class 
Night Class , 



Workiqg ^[ffedent^ 
Non-working 



"Math Effort 


Verbal "Effort 


.Cumulative Effort 


.0090 


.0107 


.0050 


. 0099, ' 


.0105 


.0060. 


(.587. 


(-.09) 


(-.65) 


•".0073 


.0078 


) . .0054 • 


.0106 


.0121 


.005* 


(-2.17) 


(-2:48) 


^ . - (-.0'8) 


. 005V» 


.0105*. 


.0057 


.0089^ , 


' m .0101 


• .0047 - 


(.25) - 


• (.17) " . 


(.78)" 


. .0075 


.0083 


.0&39' " 


.0116 


.0132 


. .0076 


(-2.M) 


(-2.62) 


(-2.27) 



Expected Grade = 
Expected Grade L-k 



Final GracTe = A 
Final. Grade /A 



,01^1 
.0081 
(2.35*) 

.0132 
.0085 
(2.24) 



Preattitude Score-High~ . 0095 
Preattitude Score-Others. 0088 
' • . (.31) 



.0135 
.0092 
°<2.17) 

.0147^ 

.0096 

(2,13) 

.0106 ■ 

.0097 

(.38) 



.0084 
.0043 
(1.84) 

.0105 
.0045 
(1.66) 

.0095 
.0046 ' 
(1.08) 
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Post-attitude Score-High . 0108 
Post-attitude Score-Others. 0085 

^ (1.33) 

"t" values in parenthesis 



.0L22: 

.0095 

(13.2) 



.0056 
.0045 
C1.31) 



r 



A 

IS. 



ERIC 



7 . 
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